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The present invention relates to a server intended for generating, from an input 
transport stream of a first type and from data of a second type, an output stream of said first 
type which notably carries said data of said second type. More specifically the invention 
relates to a server intended for generating from an input MPEG-2 transport stream and from 
5 MPEG-4 data, an output MPEG-2 transport stream which notably carries said MPEG-4 data. 

The invention also relates to a method of generating, from an input transport 
stream of a first type and from data of a second type, an output transport stream of said first 
type which notably carries said data of said second type. 

The invention further relates to a broadcasting system comprising such a 
10 server, and to a computer program for implementing such a method. 

It is known to transport data of a second type in a transport stream of a first 
type. For example, the transport of MPEG4 data over MPEG2 systems is described in the 
15 standardization document ISO/EEC JTC1/SC29/WG1 1/N3050 published by the ISO in 

January 2000 under the title "Information Technology - Generic Coding of Moving Pictures 
and Audio: Systems; Amendment 7: Transport of ISO/IEC 14496 data over ISO/IEC 13818- 
1". 

20 

One of the objects of the invention is to propose an advantageous way of 
generating said output transport stream. This is achieved with a server as described in the 
opening paragraph, said server having: 

- first means for generating an intermediate transport stream by creating available 
25 bandwidth in said input transport stream, 

- - second means for inserting said data of said second type in the available bandwidth of 
said intermediate transport stream, thereby generating said output transport stream. 

One advantage of the invention is that it avoids a complete demultiplexing of 
the input stream, thereby reducing the computing cost of the proposed functionality. 
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In an important embodiment of the invention, particularly suited for MPEG-2 / 
MPEG-4 applications, the input transport stream carries control information and the server 
has third means, upstream of said second means, for updating said control information to take 
said data of said second type into account. 
5 When the bit rate of the transport stream must not be increased, the available 

bandwidth is advantageously created as indicated in claim 2 of the present patent application. 

When the bit rate of the transport stream must be increased, the available 
bandwidth is advantageously created as indicated in claim 3 of the present patent application. 

These and other aspects of the invention will be apparent from and elucidated 
10 with reference to the description and the drawings hereinafter. 



Figure 1 is a schematic representation of a broadcasting system according to 

the invention; 

15 Figure 2 is a functional diagram showing the operations to be executed by the 

server for generating the output transport stream; 

Figure 3 is a schematic representation of the operation of bandwidth creation 
in a first embodiment of the invention, 

Figure 4 is a functional diagram describing the operation of bandwidth 
20 creation in a second embodiment of the invention. 



In the whole description the transport streams of the first type are MPEG-2 
transport streams and the data of the second type are MPEG-4 data. This is not restrictive. 

25 Figure 1 gives a schematic representation of a broadcasting system according 

to the invention. This broadcasting system comprises a server 1 intended for generating from 
an input MPEG-2 transport stream TSin, and from MPEG-4 data M4, an output MPEG-2 
transport stream TSout which notably carries the data M4. The broadcasting system also 
comprises terminal equipment 2 comprising a demultiplexing unit 21, an MPEG-4 engine 22, 

30 and an MPEG-2 audio/video decoder 23, for retrieving MPEG-2 and MPEG-4 data to be 
used by a client application 24. 

According to the MPEG-2 standard, system information is transmitted in the 
form of tables called PSI tables (PSI stands for Program System Information). These tables 
constitute the control information of the invention. Their function is to indicate how the 
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stream is constituted: it may be constituted by one or more elementary video streams, one or 
more elementary audio streams, and of MPEG-4 data streams. In the transport stream, all 
data (MPEG-2 video, MPEG-2 audio, and MPEG-4 data) are interleaved. The PSI tables are 
used at the reception to reconstitute the programs. 

Figure 2 gives a representation in blocks of the operation to be executed by the 
server 1 in order to generate the output transport stream TSout. According to Figure 2, the 
input transport stream TSin is delivered to a bandwidth creation block Bl. The bandwidth 
creation block Bl generates an intermediate transport stream TSm having available 
bandwidth. The intermediate transport stream TSm is delivered to an updating block B2. The 
function of the updating block B2 is to update the PSI tables carried in the intermediate 
transport stream TSm in order to take into account the presence of the data M4. After 
updating, the intermediate transport stream TSm is delivered to an insertion block B3. The 
insertion block B3 also receives the data M4. Its function is to insert the data M4 in the 
available bandwidth of the intermediate transport stream TSm. 

It is to be noted that MPEG-4 data may comprise audio and video data, but 
also Scene descriptions and Object descriptions. In the case where the data M4 contain Scene 
and Object descriptions it is necessary, in order to comply with the Amendment 7 of the 
MPEG-2 standard, for the data M4 to go through a synchronization layer and optionally a 
Flex/Mux layer before being delivered to the updating block B2 and to the insertion block 
B3. The function of the synchronization layer is to provide timing, synchronization, 
fragmentation and random access information relating to the elementary MPEG-4 streams. 
The function of the Flex/Mux layer is to interleave the MPEG-4 data originating from 
multiple MPEG-4 data streams. To achieve this, the server 1 optionally comprises a 
synchronization block B4 and a Flex/Mux block B5 which process the data M4 before 
delivering them to the updating block B2 and to the insertion block B3. Blocks B4 and B5 are 
represented in dotted lines in Figure 2. 

The way in which the PSI tables have to be modified to take into account the 
presence of MPEG-4 data in the MPEG-2 transport stream is defined in the Amendment 7 of 
the MPEG-2 standard. 

In practice, MPEG-2 transport streams are made up MPEG-2 transport 
packets. The insertion block B3 comprises a mapping block B31 and a replacement block 
B32. The function of the mapping block B31 is to map the data M4 into MPEG-2 transport 
packets. The function of the replacement block B32 is to replace the null transport packets of 
the intermediate transport stream TSm with the transport packets containing the data M4. For 
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example, the mapping operation is done as described in international patent application 
W099/21337 filed by Koninklijke Philips Electronics N.V. 

The invention proposes two ways of creating available bandwidth depending 
on the ability to increase the bit rate of the transport stream. 

Figure 3 illustrates a first embodiment of the bandwidth creation block Bl 
when it is possible to increase the bit rate of the transport stream. In this example the input 
transport stream TSin has a bit rate equal to R and comprises MPEG-2 video transport 
packets V, MPEG-2 audio transport packets A and null packets N. Two null transport packets 
N represented in hatched lines are inserted after each transport packet of the input transport 
stream TSin. In this example, the resulting intermediate transport stream TSm has a bit rate 
equal to 3R. In Figure 3 the t axis represents the time. 

Figure 4 illustrates a second embodiment of the bandwidth creation block Bl 
when it is impossible to increase the bit rate of the transport stream. In this embodiment, the 
bandwidth creation block Bl comprises a demultiplexing block Bl 1, a transcoding block 
B12, and a remultiplexing block B13. The demultiplexing block Bll receives the input 
transport stream TSin. Its function is to demultiplex one or more elementary video stream(s) 
carried in the input transport stream TSin. To achieve this the demultiplexing block Bll 
comprises a video packet extraction block Bl 1 1 and a transport layer removing block Bl 12. 
The function of block Bl 1 1 is to extract the transport packets corresponding to said video 
elementary stream(s) from the input transport stream TSin. The function of block Bl 12 is to 
remove the transport layer in order to retrieve the video data. The retrieved video data are 
delivered to the transcoding block B12. The function of the transcoding block B 12 is to 
decode and re-encode the video data with a lower accuracy in order to reduce the bandwidth 
they occupy. The re-encoded data are delivered to the remultiplexing block B 13. The 
remultiplexing block B 13 comprises a mapping block B 131 and a replacement block B 132. 
The function of the mapping block B131 is to map the re-encoded video data into MPEG-2 
transport packets. The function of the replacement block B 132 is to replace the extracted 
video transport packets with the transport packets containing the re-encoded video data and 
null transport packets N. In this example, the replacement block B132 delivers an 
intermediate transport stream TSm which rate is equal to the bit rate of the input transport 
stream. 

Coming back to Figure 2 it is to be noted that the data M4 to be inserted into 
the MPEG-2 transport stream may be stored locally on the server 1. They may also be 
transmitted from another remote server, for example, over an IP link. 



